Distilling Knowledge with a Teacher’s Multitask Model for Biomedical Named Entity Recognition

نویسندگان

چکیده

Single-task models (STMs) struggle to learn sophisticated representations from a finite set of annotated data. Multitask learning approaches overcome these constraints by simultaneously training various associated tasks, thereby generic among tasks sharing some layers the neural network architecture. Because this, multitask (MTMs) have better generalization properties than those single-task learning. model generalizations can be used improve results other models. STMs more in phase utilizing extracted knowledge an MTM through distillation technique where one supervises another during using its learned generalizations. This paper proposes which different MTMs are as teacher supervise student Knowledge is applied with model. We also investigated effect conditional random field (CRF) and softmax function for token-level approach, found that leveraged performance compared CRF. The result analysis was extended statistical Friedman test.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Biomedical Named Entity Recognition: A Poor Knowledge HMM-Based Approach

With a recent quick development of a molecular biology domain it becomes indispensable to promote different resources as databases and ontologies that represent the formal knowledge of the domain. As these resources have to be permanently updated, due to a constant appearance of new data, the Information Extraction (IE) methods become very useful. Named Entity Recognition (NER), that is conside...

متن کامل

Biomedical Named Entity Recognition System

We propose a machine learning approach, using a Maximum Entropy (ME) model to construct a Named Entity Recognition (NER) classifier to retrieve biomedical names from texts. In experiments, we utilize a blend of various linguistic features incorporated into the ME model to assign class labels and location within an entity sequence, and a postprocessing strategy for corrections to sequences of ta...

متن کامل

Reranking for Biomedical Named-Entity Recognition

This paper investigates improvement of automatic biomedical named-entity recognition by applying a reranking method to the COLING 2004 JNLPBA shared task of bioentity recognition. Our system has a common reranking architecture that consists of a pipeline of two statistical classifiers which are based on log-linear models. The architecture enables the reranker to take advantage of features which...

متن کامل

Named Entity Recognition in Biomedical Texts using an HMM Model

Although there exists a huge number of biomedical texts online, there is a lack of tools good enough to help people get information or knowledge from them. Named Entity Recognition (NER) becomes very important for further processing like information retrieval, information extraction and knowledge discovery. We introduce a Hidden Markov Model (HMM) for NER, with a word similarity-based smoothing...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Information

سال: 2023

ISSN: ['2078-2489']

DOI: https://doi.org/10.3390/info14050255